Visualization of music collections based on structural similarity

Users interact a lot with their personal music collections, typically using standard text-based interfaces that offer constrained functionalities based on assigned metadata or tags. Alternative visual interfaces have been developed, both to display graphical views of music collections that attempt to reflect some chosen property or organization, or to display abstract visual representations of specific songs. Yet, there are many dimensions involved in the perception and handling of music and mapping musical information into computer tractable models is a challenging problem. There is a wide variety of possible approaches and the search for novel strategies to visually represent songs and/or collections persists, targeted either at the general public or at musically trained individuals. In this paper we describe a visual interface to browse music collections that relies on a graphical metaphor designed to convey the basic musical structure of a song. An iconic representation of individual songs is coupled with a spatial placement of groups of songs that reflects their structural similarity. The iconic representation is derived from features extracted from MIDI files, rather than from audio signals. The very nature of MIDI descriptions enables the identification of simple, yet meaningful, musical structures, allowing us to extract features that support both a music comparison function and the generation of the icon. A similarity-based spatial placement is obtained by projecting the feature vectors with the Least Square Projection multidimensional projection, with feature similarity evaluated with the Dynamic Time Warping distance function. We describe the process of generating such visual representations and illustrate potentially interesting usage scenarios. keywords:Visualization of Music CollectionsMultidimensional Projection High-Dimensional Data VisualizationSimilarity-based Visualizations